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Abstract 

In this paper we shall consider some famous means such as arithmetic, har- 
monic, geometric, root square mean, etc. Considering the difference of these 
means, we can establish [5] [6]. some inequalities among them. Interestingly, 
the difference of mean considered is convex functions. Applying some proper- 
ties, upper bounds on the probability of error are established in this paper. It is 
also shown that the results obtained are sharper than obtained directly applying 
known inequalities. 

1 Introduction 

Taneja [BJ [7] considered the following inequality among some well-known means: 

H(a,b) < G{a,b) < N^a.b) < N 3 {a,b) < N 2 {a,b) < A(a,b) < S(a,b), (1) 

where 
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and 



S(a,b) 



a 2 + b 2 
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for all a, b 6 (0, oo) 

The means, H(a,b), G(a,b), A{a,b) and S(a,b) are known in the literature as 
harmonic, geometric, arithmetic and root-square means respectively. For simplicity, we 
can call the mean, N\ as square-root mean. The N^ia, b) can be seen in Taneja [5] and 
the mean N 3 (a, b) can be seen in Zhang and Wu |9 a . Schur-geometric convexity of the 
means appearing in ^ can be seen in [TUJ [11] 

The above measures can be written in terms of arithmetic and geometric means. 
See below 




N 3 (a,b) 



2A(a,b) + G(a,b) 
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H{a,b) 



(G(a,b)) 2 
A{a,b) 



and 



S(a,b) 



VA(a*,b 2 ). 



2 Inequalities among difference of means 



Let us consider the following nonnegative difference of means: 



M SA (a,b 



S(a, b 



A(a,b), 



(2) 



M S n 2 (a, b] 
M S n 3 (a, b] 
Msni (a, b] 
M SG (a,b] 
M SH (a,b] 
Man 2 (a, b] 
M AG (a,b] 
M AH (a,b] 
M N2Nl (a, b 



S(a,b) - N 2 (a,b), 
S(a,b) - N 3 (a,b), 
S(a,b) -Ni(a,b), 
S(a, b) — G(a, b), 
S(a, b) — H(a, b), 
A(a,b) - N 2 (a,b), 
A(a,b) - G(a,b), 
A(a,b) - H{a,b), 
N 2 (a,b) - JVi(o,6) 



(3) 
(4) 
(5) 
(6) 
(7) 
(8) 
(9) 
(10) 
(11) 
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and 

M N2G (a,b) =N 2 (a,b)-G(a,b). (12) 

The convexity of the means (j2"1)- (fT2")) can be seen in Taneja [SJ El E] . The Schur- 
geometric convexity is given in |10) . The mean difference Mn 2 n 3 (cl, b) is not considered 
here, since it is not convex. 

Taneja [B] proved the following inequalities among the difference of means: 

M SA (a, b) < ^M SH (a, b) < ~M AH (a, b) < -M SG (a, b) < M AG (a, b), (13) 

lM AH (a,b) < M N2Nl (a,b) < -M N2 a(a,b) < -M AG (a,b) < M AN2 (a,b), (14) 

a o 4 

-M SA {a, b) < -M SN2 (a, b) < M AN2 (a, b), (15) 
4 5 

^M SH (a, b) < M SNl (a, b) < ^M SG (a, b) (16) 

and 

M SA (a,b) < -M SN3 (a,b) < -M SNl (a,b). (17) 

The aim of this paper is to obtain bounds on the probability of error in terms of 
the means given in ([2|)- (fT2)) , 

3 /—Divergence and Probability of Error 

Csiszar [2] have given a measure for the divergence between two probability density 
functions, say p(x) and q(x). This so called /—divergence given by 

Cf( P ,q)= J f (^|) q(x)dx. (18) 

X 

The function /(x), with x <E (0, oo) is a convex function which has to satisfy the 
conditions 

/(0) = lim/(u); 0/ (I) = ; 0/ (~) = lim e / (~) = a lim M. (19) 

It can be easily checked that Cf(p,q) > /(l) and that Cf(p,q) = /(l) only when 
p(x) = q(x) a.e. Thus, C/(p, q) — /(l) is a distance or divergence measure in the sense 
that Cf(p,q) — /(l) > 0. However, it is not symmetric in p and q and in general does 
not satisfy triangle inequality. 

Boekee and Van der Lubbe pQ have introduced the average /—divergence between 
two hypothesis C\ and C2 in terms of their "a posteriori" probabilities. This average 
/—divergence is defined as 

x 



3 



If we introduce the function 

f*(u) = uf n " 

and set u = u(x) = P{C2\x), it is easy to see from P{C\\x) = 1 — P(C2\x) that 

X 

(21) 

From Vajda [5] it follows that f*(u) is convex on [0, 1] and is strictly convex iff f(u) 
is strictly convex. 

3.1 A Class of Upper Bounds 

In pQ it has been shown that the Bayesian probability of error can be upper bounds in 
terms of the average f —divergence C /(Ci, C2). This upper bound is given by 

Pe < hP(C 2 ) + fooPjC,) -C S {C U C 2 ) ^ 
J2 - fl 

where / 2 should be finite with 

/ = lim /(«); A = /(l); f 2 = f + /oo! /oo = 1ml (23) 

The above bound is valid only for every convex function f(u) which satisfies the 
conditions given in (fT9|) . However, if f*(u) = uf (-^p-) is symmetric with respect to 
11 = i i.e., f*(u) — /*(1 — u), this bound can be written in a simpler form given in the 
following theorem. 

Theorem 3.1 The probability of error is upper bounds by C f{C\,C2), where f*(u) = 
f*(l — u) is symmetric with respect to u— \, as follows: 

Pe < 1 [/oo - C f (d,C 2 )] , (24) 
z Joo — Jl 

provided f x is finite. 

If fi = /(I) = an d /oo is finite, then the above bound can be written as 



P e < 1 - 
~ 2 



1- -Lc f (C u C 2 ) 

J 00 



(25) 



In this paper we shall apply the upper bound (|25j) for different divergences based 
on difference of means given by ([2l- (|12p . 
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4 Bounds on the Probability of Error in terms of 
Difference Mean Divergences 

In this section we shall give bounds on the probability of error in terms of the mean 
differences given by (l2"j)- (TT2l based the Theorem 3.1. 

Result 4.1. Let us consider the measure 



where 



f SA {x) =xf SA 



1 -x 



with 



fsA(x) 



x 2 + 1 x + 1 



, Vx € (0,oo). 



2 2 

The convexity of the function fsA(x) can be seen in 5, 6 . In this case we have 



1 



x— s-oo x Z 



(26) 
(27) 



and 



/s^(l) = 0. (28) 

Expression (|2"5j) together with (j2"o]) - (l2"51) give the following upper bound on the 
probability of error 



r<4 



1 



,V2 - 1 

Result 4.2. Let us consider the measure 



M S a(C 1 ,C 2 ) 



where 



/<?W 2 fa) = x /SJV 2 



1 -X 



with 



W*) = J^P- - ( J X -i±, V, e (0,oo). 



(29) 



2 V 2 / V 2 
The convexity of the function fsN 2 ( x ) can be seen in[5l|6]. In this case we have 

f*SN 2 (x) = X + (1 ~ ^ - VT ^) = f * SN ^ ~ X) ' (30) 
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fsN 2 (x) _ y/2 



IE— J-OC X 



(31) 



and 



Wl) = 0. (32) 
Expression (j2"S"j) together with (|3ll|) - (l52l give the following upper bound on the 



probability of error 



Pe < 



1 



1 — —^Msn 2 (Ci, C 2 ) 



(33) 



Result 4.3. Let us consider the measure 



where 



Msn 3 (Ci,C 2 ) — Ex yfsN-. 

fsN 3 ( x ) =xfsN 3 



\P(C 2 \x 
l-x 



P(C!\X) 



with 



/sjv 3 [x) 



x 2 + 1 x + y/x+1 



Vx e (0,oo) 



2 3 

The convexity of the function Jsn 3 (x) can be seen in [5j [6] ■ In this case we have 

/W*) = ^yV^TW^W- Vx(l-x)) = f* SN3 (l - x), (34) 

f SA (x)_V2 l_3V2-2 



f(SN 3 ) x = lim 



x— >oo X 



G 



(35) 



and 



W1) = 0. (36) 
Expression (|25p together with (j3"4")) - (l3"(3l) give the following upper bound on the 



probability of error 



Pr < 



1 



G 



3^2-2 



Msn 3 (Ci, C 2 ) 



(37) 



Result 4.4. Let us consider the measure 



where 



with 



Msn% (Ci, C 2 ) — £x WSATj 



P(C 2 |x) 

l-x 



P(C!\X) 



fsNi {x) = 



x 2 + 1 (y/x + 1 



Vx e (0,00). 
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The convexity of the function /<j ^ (x) can be seen in [SJ |S] . In this case we have 

V2 1 2V2-1 



lim 

x — >oo X 



(39) 



and 



/S^(1) = 0. (40) 
Expression (|25l) together with ([55|) -(|4U | give the following upper bound on the 



probability of error 



P,. < 



2V2- 1 



M SNl (C u C 2 ) 



(41) 



Result 4.5. Let us consider the measure 



where 



with 



M sg{C\,C 2 ) — E x <yfsa 

fsc(x) =xfsG 



P(Ci\x) 
P(C 2 \x) 

l-x 



P(Ci|x) 



f SG (x) 



x 2 + l 



/x, Vx € (0, 00). 



The convexity of the function fsdx) can be seen in [5, 6 . In this case we have 



/sg(*) = ^§v^ + (i-xr- v^r^y = r SG ^ x), 



f(SG) c 



lim 



Jsg(x) V2 



and 



x— ¥00 x 



/«?(!)= 0. 



(42) 
(43) 
(44) 



Expression (|25p together with Pdj) -([4"3" |) give the following upper bound on the 
probability of error 



~ 2 



1- — M SG (Ci,C 2 ) 



(45) 



Result 4.6. Let us consider the measure 



where 



M SH (C 1 ,C 2 ) = E x ^r SH 

fsH(x) =xf SH 



(P{Cx\x) 



\P(C 2 \x 
l-x 



P(C x \x)\, 
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with 



fsH(x) 



X 2 + 1 



2.r 



Vx G (0,oo). 



2 x + V 

The convexity of the function /sfj(x) can be seen in [SJ [6] . In this case we have 



V2 



fsH(x) = ^-y/x 2 + (l-x) 2 -2x(l - x ) = f* SH (l - x), 



f(SH) c 



Jsh(x) V2 



lim 

x— i-oc x 



(46) 
(47) 



and 



Jsh(1) = 0. (48) 
Expression (|25|) together with (j46" |) - (j48"l) give the following upper bound on the 



probability of error 



P,. < 



1 



l-—M SH (C 1 ,C 2 ) 



(49) 



Result 4.7. Let us consider the measure 



M AN2 (C 1 ,C 2 ) = E x ifX N , 



( P(C 



where 



f*AN 2 {x) =x/an- 



\P(C 2 \x 
l-x 



P{Ci\x) 



with 



Ian 2 (x) 



x + 1 



x + 1 \ x+l 



-, Vx G (0, 00). 



2 V 2 

The convexity of the function Jan 2 ( x ) can be seen in 16] . In this case we have 

1 V2 



fAN 2 ( x ) = ^ - (V^ + Vl-x) = /1at 3 (1 - z), 



f(AN 2 ) 00 = nm 



Ian 2 (x) 1 72 2-V2 



(50) 
(51) 



and 



/Wl) = 0. (52) 
Expression (|25p together with ([5D|) - (l5^1) give the following upper bound on the 



probability of error 



Pe < 



1 



1 - 



2 - V2 



M A n 2 {C u C 2 



(53) 



Result 4.8. Let us consider the measure 



M AG (C u C 2 ) = E x {fX G 



P{C 2 \x) 
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where 

f% G (x)=xf AG 
with 

x + 1 

/agO) = — 2 V^i e (0, oo). 

The convexity of the function J A g(x) can be seen in [5,6. In this case we have 

1 



r AG (x) = --y/x(i- x ) = r AG (i~x), (54) 

, Jag{x) 1 , . 

J(AG) = lim = - (55) 

and 

SagO) = 0. (56) 

Expression (j2"5j) together with (j52")) -(l54" |) give the following upper bound on the 
probability of error 

P e <^[l-2M AG (C 1 ,C 2 )]. (57) 
Result 4.9. Let us consider the measure 

where 

A 1 — x 

f*AH{ x )= x fAH 

with 

.T + 1 2x 

!ah{x) = — — , Vx e (0,oo). 

2 a; + 1 

The convexity of the function f A n(x) can be seen in [5j [6] . In this case we have 

P AH {x) = \{2x-\f = f AH (l-x), (58) 

f(AH) = hm = - (59) 

x->oo x 2 

and 

/ah(1) = 0. (60) 

Expression (|25p together with ([55|) -(|BU | give the following upper bound on the 
probability of error 

P e < \ [1-2M M (C 1( C 2 )]. (61) 
Result 4.10. Let us consider the measure 
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Where 



1 - x 



with 



/n 2 n 1 {x) 



y/x+l\ x + 1 f^/x + 1 



, Vx € (0, oo). 



The convexity of the function fN 2 N t (x) can be seen in [51 [B]. In this case we have 
fkm (?) = ^(Vx-+ VT^) + 2^/x(l-x)) = f* N2Ni (1 - x), (62) 

f N2Nl (x)_V2 1 2V2-1 



f(N 2 N 1 ) oo = lim 



(63) 



and 



/ iV2JVl (l)=0. (64) 
Expression (|25l) together with give the following upper bound on the 



probability of error 



Pp. < 



1 



1 - 



4 

Mn 2 n ± (Ci, C2) 



2V2-1 



(65) 



Result 4.11. Let us consider the measure 
M N2 g(C 1: C 2 ) = £jf |/iv 2 G 
where 



p(Cik) 



P(Ci|z) 



/at 2 g(^) = x/n 2 g 



l~x 



with 



In 2 g(x) 



x + l\ x+1 



<x, Vx € (0, 00). 



The convexity of the function fN 2 c(x) can be seen in [SJ|B]. In this case we have 
V2 



focO*) = X + - V^O 3 *) = /%g(1 - x), (66) 



/ (JV2G) = Jim 



Jn 2 g(x) V2 



x—toc x 



(67) 



and 



/iV 2 JVi(l) = 0- 

Expression (|25p together with (|66| - (f68l) give the following upper bound on the 



probability of error 



P, < 



4 

1 — — j=Mn 2 n 1 (Ci, C2) 



(69) 
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4.1 Final Remarks 

(i) According to inequalities ([T^]) and the result ([57]) . we have 

P e <\ [l~2M AG (C 1 ,C 2 )] < \ [l-M SG (Ci,C 2 )] < \ [l-M AH (C\,C 2 )] < 



1 

< - 
~ 2 



l-~M SJJ (Ci,C 2 ) 



< i [1-2M S a(C 1 ,C 2 ) 



(70) 



From ([70]) and (|45|) . we have 



l--^=M SG (C ll C 2 ) 



< - [1-M SG (C U C 2 ) 



Again from ([70)1 and (I5T1) . we have 



P e < 1 [1 - 2M AH (C 1 , C 2 )\ <\[l- M AH (C 1) C 2 )] • 



(71) 



(72) 



From the expressions ([TTj) and (|T2"j) we observe that the results obtained here indi- 
vidually are sharper than that we get from the inequalities given in (|13[) . 

(ii) According to inequalities (fT6|) and the result (|45jl . we have 



P. <- 



1-- 7 =M SG (C 1 ,C 2 ) 



< 



< 



3N/2 



< 



3V2 



M sh{Ci,C 2 



From (J7SI) and (gj), we have 



(73) 



Pe < 



2\/2-l 



< 



3N/2 



(74) 



Again from (|73|) and (|49| we have 



P.< 1 - 
~ 2 



l-^d.Ca) 



1 

< - 
~ 2 



l--±=M 5ff (C 1 ,C a ) 



(75) 



From the expressions (f?4"f and ([75]). we observe that the results obtained here 
individually are sharper than that we get from the inequalities given in (|16[) . 

Similarly, we can compare other results proving that the results obtained individu- 
ally are sharper than applying directly the inequalities given in (fT5)) - ([TTj) . More studies 
on probability of error having different entropy-type and generalized divergence mea- 
sures can be seen in Taneja [3l 0] 



11 



References 



[1] D.E. BOEKEE and J.C. VAN DER LUBBE, Some Aspects of Error Bounds in 
Feature Selection, Pattern Recognition, 11(1979), 353-360. 

[2] I. CSISZAR, Information Type Measures of Differences of Probability Distribution 
and Indirect Observations, Studia Math. Hungarica, 2(1967), 299-318. 

[3] I.J. TANEJA, On Generalized Information Measures and Their Applications, 
Chapter in: Advances in Electronics and Electron Physics, Ed. P.W. Hawkes, 
Academic Press, 76(1989), 327-413. 

[4] I.J. TANEJA, New Developments in Generalized Information Measures, Chapter 
in: Advances in Imaging and Electron Physics, Ed. P.W. Hawkes, 91(1995), 37- 
136. 

[5] I.J. TANEJA, On Symmetric and Nonsymmeric Divergence Measures and 
Their Generalizations, Chapter in: Advances in Imaging and Electron Physics, 
138(2005), 177-250. 

[6] I.J. TANEJA, Refinement of Inequalities among Means, Journal of Combinatorics, 
Information and Systems Sciences, (special issue in honor of Prof. B.D. Sharma) 
Edited by Prof. Sat Gupta, Vol. 31(2006), 357-378. 

[7] I.J. TANEJA, On Mean Divergence Measures, Advances in Inequalities from Prob- 
ability Theory and Statistics - Edited by N.S. Barnett and S.S. Dragomir, Nova 
Science Publishers, 2008, 195-215. 

[8] VAJDA, I. On the /—divergence and singularity of probability measures, Periodica 
Math. Hunger, 2(1972), 223-234. 

[9] ZHI-HUA ZHANG and YU-DONG WU, The New Bounds of the Logarithmic 
Mean, RGMIA Research Report Collection, http://rgmia.vu.edu.au, 7(2)(2004), 
Art. 7. 

[10] H. N. SHI, J. ZHANG and DA-MAO LI, Schur-Geometric Convexity for Difference 
of Means, Applied Mathematics E-Notes, 10(2010), 275-284 

[11] HUAN NAN SHI and JIAN ZHANG, Schur-Geometric Concavity for Difference 
of Means, available on line - http://rgmia.org/papers/vl2n4/huannan2.pdf 2010, 
1-12 

e-mail: ijtaneja@gmail.com 



web-site: http:/ / www. mtm.ufsc. br/~ taneja 



12 



